Upper and lower bounds for the reliability measure of 
a discrete distribution conditionally on the first three 

moments 
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Abstract 

We give sharp bounds for the rehabihty measure of a discrete r.v. defined on 
{0, . . . , n}, conditionally on the knowledge of the first three moments of the r.v. 
The present work is as an extension of the results given in [Di Cecco, Stat. Prob. 
Lett., 81(2011), 411-416]. 
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1 Introduction 

Let S* be a discrete r.v. defined on the integers {0, . . . ,n} and P be its distribution. Let 
Rk,n denotes the probability P{S > k), and let jii be the i-th moment of S, jii = E[S^]. 
In the present paper we give exact upper and lower bounds for for any k G 

{0, . . . , n}, conditionally on the knowledge of the first three moments of S*, /ii, /i2, and 
/X3. Additionally, we define the two extremal distributions on {0, . . . , n} consistent with 
the given /ii, and /^3, achieving the maximum and the minimum for Rk,n- 

A finite discrete distribution on {0, . . . ,n\ is completely identified by its first n mo- 
ments. In fact, the distribution of S (and Ru.n too), can be written in terms of its first 
n factorial moments, pt,; = E , i = 1, . . . ,n, (see, e.g., [7]): 



i—k i—k 



* email: davide.diceccoOgmail.com 



1 



but the following relations hold between ordinary moments and factorial moments: 



lij = S2{j, i) fj,,, fij = Sl{j, i) fii, (2) 

i=l i=l 

where Sl{j, i) and S2{j, i) are the Stirling numbers of the first and of the second kind 
respectively. Then, the distribution of S can be parameterized in terms of //i, . . . 

For any r.v. S defined on {0, . . . , n} we have (or we can construct) a sequence 
(Xi, . . . ,Xn) of exchangeable Bernoulli r.v.s, such that S can be viewed as the tally 
variable of a set of n events (S — X]"=i -^i)- There is an obvious one to one relation 
between their distribution which is given by 

P{S = k)^ (l)P{Xl =Xi,...,Xn=Xn) with =fc, 



i=l 



and we can equivalently refer to the sequence or to the counting variable. 

Many ways to parameterize the joint distribution of n exchangeable Bernoulli r.v.s 
{Xi, . . . ,Xn) (and hence the distribution of S), have been explored. De Finetti since 
his earlier works introduced a parameterization in terms of the parameters (wi, . . . , Wn) 
where 

=P(Xi = = I) = E[Xi ■ ■ ■ X,]. 

Bahadur in [T] introduced a parameterization in terms of the generalized correlations 
(/92, ■ • ■ , Pn) where 

_ E[{Xi - wi) ■ ■ ■ {X, - wi)] 
[wi{l - wi)]i 

There is a one to one relation between the first m elements of each one of the three param- 
eterizations: (u>i, . . . , Wm), {wi, P2, ■ ■ ■ , Pm), and (pi, . . . , pm) for any m G {1, . . . , n}. In 
fact, we have that Jii ~ (")i!u'i, then, by the relations between the paramctrs Wi and 
the parameters pi arc immediately derived; while the relations between the parameters 
Wi and the parameters pi can be found in [3] 

As a consequence of these relations, we have the equivalence of the bounds of Rk,n 
conditioned on the knowledge of the first m parameters of any of the three parameteri- 
zations: 

max max max 

— Rk,n{Wl, . . . ,Wrn) = — Rk,n(Wl,P2: ■ ■ ■ , Pm) = — itfc,n(Ml, . . . , P-mj ■ 
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In |5| sharp bounds for Rk,n{wi) are given, and in [3] sharp bounds for Rk,n iwi, P2) 
are given. In the present paper, in order to extend those rcsuhs to the first 3 parameters, 
we use the moment parameterization, essentiahy for two reasons: firstly, formulae for 
the bounds of Rk,n in terms of {fii, fi2, fJ-s) have been proved to be simpler; secondly, 
we want to show a link with the existing literature that mostly refers to the moment 
parameterization, rather than the other two parametcrizations. 

The result we obtain has an immediate interpretation in Reliability theory, as Rk,n 
represents the reliability of a fc-out-of-n system, i.e., the probability that, in a system 
of n exchangeable components, at least k will function. Approximated bounds for the 
reliability measure of a discrete distribution conditioned on its first (binomial) moments 
are obtained via linear programming in [7]. For an analogous result on the reliability 
function of a continuous distribution conditioned on the first moments see [5]. An- 
other example of a possible application of the presented result involves developments 
of Condorcet's Jury Theorem (see [S] and references therein), studying the scenario of 
dichotomous voting in a jury (group of experts) with a majority voting rule and certain 
hypotheses of dependence among the jurors. 

The present paper is a direct extension of the geometric approach described in [3] 
(which, by the way, can be easily employed to find sharp bounds for the probability 
P{S ~ k) of S being exactly equal to fc), but it can be read on its own. In Section [5] we 
present that geometric approach, in Section [3] we use it to state our result. 



2 Some Geometry 



To outline our geometric approach, it is convenient to introduce some notation. The 



convex hull of a set of points will be denoted in angle brackets: (■). Let yi, 
points in a (m — 1) -dimensional space, where yi = (yi,i, 
will denote the following: 



det 



1 yi,i 



■•,yj,m-i) ; then ||yi,. 



\ 1 



r 1 J 



,ym be 

■ ■ ,ym| 



Let p be a point in the (m— l)-dimensional space: when p is variable, | |yi, . . . , ym-i,p\ \ = 
is the equation of the hyperplane H containing points yi, . . . ,y,n-i; while, if p is a 
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fixed point, tlie sign of tlie determinant Hyi, . . . , ym-i,p\\ reveals in wliicli side of H p 
lies. 

Remark. In order to simplify the formulae that we are going to describe, we normalize 
S, dividing it by n. So, from now on, pj will denote the j-th moment of the r.v. S/n: 
fjLj = E {S/nY . In this manner, G [0, 1] , Vj, and /ii = wi. 

In order to find exact bounds for Rk,n given (fii, . . . , fJ-m)-, we will consider the space 
*^i"n of the admissible values for the array of parameters (/ii, . . . i?fc_„). We will 
show that is a bounded convex polytope of m + 1 affine dimensions, and hence 

we can calculate the maximum and the minimum of Rk.n given (/ii, . . . , /i„i) by finding 
the two points of intersection of the vertical line passing through (/ii, . . . , 0) and 
{fii, . . . , firn, 1), with the upper and the lower boundaries of 

The space of the parameters {fii, . . . , fin), denote it A^„, is known to be an n- 
dimensional convex polytope defined as the convex hull of the vertices {wi,n}i=o,...,n 
(see, e.g., [6]), where 





Denote as mIT^^ the orthogonal projection of Mn over the first m axes. Obviously, 
A^»r' = {v["n , . . . , ) where 



(m) 




Let Cd{t) be . . . ,t'^Y'; the d-th order moment curve is the curve parametrically 

defined as: {cd{t) | < t < 1}. Both Adn and Mn^^ are convex hulls of a set of points 
on the moment curve, hence are cyclic polytopes (see, e.g., [4]). 

Each vertex Vi^n of A^„ represents the distribution S* having P{S* = i) = 1. Under 
S* , we have Rk,n = 1 if i > fc, and Rk.n = if i < fc. By ([T|) and we can see that 
Rk,n is a linear function of (/^i, . . . ,/.*„). Define the point r'fl,\ G R™+-'^ as (w.l^^O) if 
i < k and (w-"\ 1) if « > k; then, (r*j™^„, . . . ,r^™^^) is exactly our space So 
is defined as the convex hull of two sets of points lying on two parallel hyperplanes 
(identified by Rk.n = and Rk.n — 1): this kind of convex polytope is sometimes called 
prismoid or prismatoid. {r'^^, • ■ • ' ''fc-i fen) ^he lower base of the prismatoid, call it 
{i"k^kn^ ■ ■ ■ '''ri"fc\i) ~ is the upper base. The following theorem, whose proof is 
in Appendix, shed some light on the structure of ^k'n- 



Theorem 2.1. Any m + 2 vertices of „ are affinely independent unless they all 
belong to the same base. 

By Theorem 12.11 each facet (m-dnTiensional face) of other than Bl and Bu, 

is a simplex of m + 1 vertices. The projection of ^^^^ over the plane of the first m axes 
is A4^\ In particular, the projection of each facet of ^^^^ is a simplex inside A^i™\ 
so, the projections of the upper and the lower hulls of provide two subdivisions of 
TWl"'. Wecall them the upper and the lower subdivisions. Obviously, the given (/ii, . . . , 
jj,m) is a point of A^i™'' . To determine the intersections of with the boundary of , 
it suffices to find the two simplcxes of the upper and the lower subdivisions of A^i™'' 
containing (/ii, . . . , fJ-m), and then find the intersections of with the two supporting 
hyperplanes of relative to the facets corresponding to those simplexes. In the 

following Section l3.ll we state how to determine the simplexes containing (//i,^2,M3) 

(3) 

in the upper and lower subdivisions of A^„ . 



3 The main result 



3.1 Point location 

(3) . (3) 

For ease of notation, in the following we will denote „ simply as r;, and v^^ as Vi. 

(3) 

The following theorem, whose proof is in appendix, defines the facial structure of ^j. ^. 

(3) 

Theorem 3.1. The upper facets o/*i>fe„ are: 



{{ro,r,,r,+i,rk)}^^^ 

{{ro,rk,r,,r,+,)}^^^^^^^^^^^_^; 

{(rt,rt+i,rfc,r„)}^^P^ 



f3) 

The lower facets of (f>j, ^ are: 



Bl = {{ro,ri,ri+i,rk^i)}^^^^ 
{(ro,rfe-i,r„r,+i)},^^^^ 

{(^t'^t+i'^fe-i'^")}t=o,...,fe-3 
. {i^k-i,rurt+ur„)}^^^ 



,fc-3' 



n-2" 
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A4n is a cyclic polytopc, and its facial structure is well known: its faces are {(wo, Vi, Vi+i)}^_^ 
and {{vt,Vt+i,Vn)}^_Q We note in passing that all the facets of arc of the 

kind (i^, J'fc) or J'fc-i), for F being a face of A^,?"*. 

Let /i be the point representing the array of the given parameters (/ii, /^2, /^s)- The 
projections of the upper facets of form the upper subdivision of A^,?\ and can be 
divided into 4 groups of simplexes which we will call blocks: 



{('(;o,Wj,'yj+i,'yfc)}^^^_ ,,_2 

{(«*'"t+l'"fe'"")}t=0,...,fc-2 
^U^ = {{Vk,Vt,Vt+l,Vn)} 



t=k+l, 



block 1 
block 2 
block 3 
block 4 



All the simplexes in blocks 1 and 2 have the edge (uq, Wfe) in common, so, if the point 
/i is in block 1 or 2, to determine the simplex (wq, Wfc, I'i* , containing it, we can 
consider the dihedral angle ^ between the two planes having equations ||t;o,Wfc,Wn,p|| = 
and ||wo, I'fc, = 0. We can calculate the cosine of ^ and, equalling it to the cosine 

of the dihedral angle between ||do, w/j, fn,p| | = and ||wo, Wfe, = and solving for 
i*, wc obtain: 



n^2 - kill 



(3) 



where [-J denotes the floor function. All the simplexes in blocks 3 and Bjj have the edge 
{vk, Vn) in common. Then, if /i is in block 3 or B\j , we find the simplex (w^, Vf , Wf+i, Vn) 
containing it by equalling the cosine of the dihedral angle determined by the two planes 
||uo,ffc,Wn,p|| = and ||i;t»,z;fe,'(;„,p|| = and the cosine of the dihedral angle between 
||z;o,ffc,'yn,p|| = and ||?;^, w^, w„,p|| = 0. Solving for t* we obtain: 



t* = 



n{n^'i - (fc + n)^2 + k^ii) 



n/i2 — (fc + n)^i + k 

3.2 The extremal distributions 



(4) 



At this point, with few algebra, we obtain the extremal distribution 5*^ on {0, . . . , n} 
consistent with /xi, /i2 and /is, achieving the maximum for Rk,n'- we get /i as a convex 
combination of the vertices of the simplex of ^An containing it, and the coefficients of 
that combination define 5+. The extremal distribution is clearly unique, as none of the 

(3) 

facets of $^ „ is orthogonal to the plane of the first 3 axes, so intersects the upper 
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boundary of „ in a single point. 5*+ concentrates the mass on four points, and, if /x 
is contained in (fg, Ufc, Ui- , is defined as 





k 



with prob. ttq = 1 - TTfe - TTi. - tt^.+i; 

n[n2//3-(2i* + l)7iAt2 + i*(i* + l)/^i 
with prob. TTfc ~ 



with prob. tt^. 



A:(fc-i*)(fc-i*-l) 
n[n2^3 - (A; + i* + l)n/i2 + + _ (5) 



i* + 1 with prob. TTi.+i = 



j*(fc - z*) 
—n[n^fi3 — (fc + i*)n^2 + ki*fj.i 
(i* + l)(fc - - 1) 



Moreover, if fi is in block 1 (i* < fc), we have that niax(i?fc.„) = tt^; if /i is in block 2 
{i* > k), niax(i?fc_„) = TTfc + TTi. +7ri.+i. When /i is in {vk.Vf ,Vf+i,Vn) , S+ is defined 



as 



k with prob. pk = 

t* with prob. pf — 



t* + I with prob. Pf+i 



n[n'^fi3 - n{n + 2t* + 1)^2 + [t*^ + "^nt* +n + t*)fii - [t* + l)t*] 
{k ^ n){k - t*){k - t* - I) ' 
—n[n?jj,3 — n{n + k + t* + l)/i2 + {k + n + kn + kt* + — /c — kt*] 

(fc - t*){n - t*) 
n[n'^^i3 - n{k + n + t*)^2 + {nt* + kn + kt*)^ii - kt*] 



{k-t* - l){n -t* - I) 
with prob. p„ = 1 - Pfc - Pf - Pt'+i- 

(6) 

in which case, if /i is in block 3 (<* < fc), we have that niax(i?fc.„) — pk +Pn and, if fi is 
in b'^'' {t* > fc), ma.x{Rk,n) = 1- 

If fi is in block 1 or 2, i*, as defined by (jSj, is well defined, while t* , as defined by 
can be out of the range {0, . . . , n} and viceversa if ^ is in block 3 or in B^ -' . That 
is, one between i* and t* (but not both) can be inadmissible, in which case, we can 
immediately state that the simplex containing jj is the one determined by the remaining 
value which is admissible. Otherwise, to determine which of the two simplexes contains 
/Lt, we can simply check which between (ttq, tt/j, tt^* , 7ri*_(.i) and {pk^pt* TPt'+i,Pn) is a 
proper distribution. In fact, one and one only of the two would be a set of values in [0, 1] 
summing to 1. 

As regards to min(i?fc^„(/ii, /i2, /^s)), we proceed similarly, by dividing the lower sub- 
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division of M.n into 4 groups of simplexes (blocks): 



^L^ = {^"0'^»'"»+l'"'=-l)}j=l,...,fe-3 ^^^"^^ ^' 

{{vo,Vk-i,v^,v^+i)].^^ block 2; 

{{vt,Vt+i,Vk-i,Vn)] block 3; 
{(wfc_i,i;t,wt+i,z;„)}^^^^ block 4. 

Then, the passages are the same as those of the upper bound, so we limit ourselves to 
say that formulas ([3]) and (|4]), are valid with fc — 1 substituting k, and the corresponding 
extremal distribution is defined by (O and ^ with k — \ substituting fc. In this 
case, if /i is in block 1 (i* < fc'), we have that niin(i?fc_„) — 0; if /i is in block 2 (i* > fc), 
min(i?fe.„) ~ TT^. + 7ri*-|_i; if /i is in block 3 {t* < fc), min(i?/j^„) = p„; if /i is in block 4 
(t* > fc), min(i?fc,„) =pt' +Pf+i +Pn- 

To give an example of the results obtained, we show in Figure [T] the bounds of Rk,n 
as a function of u'l , having fixed p2 and (we condition on the correlation parameters 
as they probably have a more interesting interpretability than the moments). Note that, 
when we fix pa, wi cannot range freely in [0, 1], but has a narrower interval of range 
which also depends on wi, p2, and n. 




Figure 1: Shaded areas represent the space of the admissible values for (wi, i?4,7) when 
no parameter is fixed (left), when we fix p2 — 0.2 (middle), and when we fix p2 = 0.2 
and p3 = 0.1 (right). Note that in the last case 0.03883 < wi 0.94867. 
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Appendix A: Proof of Theorem 12.1 

Suppose Theorem 12.11 is false. Then, m + 2 vertices r^^, . . . ,ri^_^^^ of which do 

not belong all to the same base, lie on a common m-dimensional hyperplane H. Fix, 
w.l.o.g., ii < . . . < it < k < it+i < . . . < i„i+2- That is, r,;j , . . . , r^^ belong to H D B^, 
while Tij^j , • • • , ''i„,+2 belong to H D Bjj. So, the two sets of vertices lie on two (m — 1)- 
dimensional parallel hyperplanes, and the same is valid for their orthogonal projections 
over the first m axes (orthogonal projections maintain parallelism). That is, two sets of 
vertices, ii^^ , . . . , vt^ and Vi^^-^ , . . . , Wi„+2 > of -Mr"^^ lie on two parallel hyperplanes. Now, 
since the points Vi belong to the moment curve, there exist coefficients oq, . . . , am such 
that the equation 

an + aix + a2X^ + . . . + a„i.T™ = (7) 
has (at least) t real roots ii, . . . , if ; and there exists fepi &o 7^ a^, such that the equation 

6o + aix + 022;^ + . . . + amX™ — (8) 

has at least m + 2 — t roots it+i, ■ ■ ■ , im+2- Equations ^ and ([8]) have at most m real 
roots and the corresponding polynomial curves have at most m — 1 local maxima and 
minima. It is easy to see that, whether m is odd or even (Figure [2] on the right and left 
respectively), (O can have (at most) m + 1 — t roots greater than it- So, m + 2 vertices 
lying on two parallel hyperplanes cannot exist. 



Figure 2: An example of the disposition of the solution set when to = 4 (left) and to = 5 
(right). 
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Appendix B: Proof of Theorem 13.1 



By Theorem 1 2. 11 any 5 vertices of are linearly independent, hence, each facet other 
than Bl and Bij is a simplex of 4 vertices, say r^, r^, rc, r^. To find the facets, we 
search for the quadruples {a,b,c,d) such that the hyperplane H passing through Tq, 

(3) 

Tb-, Tci fd is a supporting hyperplane of i.e., such that all other vertices of 

n '^'^ same side of H. That is, we search for the quadruples (a, 6, c, d) such 
that the determinant ll^a, r^, Tc, r^;, r^||, as a function of x, has the same sign for all 
a; e {0, . . . , n}\{a, b, c, d}. Fix 0<a<b<c<d<n. Three cases are possible: 

1) a<k<b; 

2) b<k<c; 

3) c<k <d. 

In case 3) we have ||ra, r^, Tc, Tj^, r^;]] = n^det(^) where 



\ I det(A5,5) - det(A4_5) if x > k; 




det{A) = dot I 1 c c'l cl 

1 X {x>k} , 



det(yl4,5) if a; < A:. 



Here Ai,j denotes the minor obtained from A by removing the i~th row and the j-th 
column. ^4^5 and ^5^5 are Vandcrmonde matrices, hence, if a; < fc, det(^) is equal to 
the following polynomial: 

det(A) — —(6 — a)(c — a)(c — b){x — a){x — b){x — c), 

which is clearly different from zero for x ^ a,b^c and changes sign whenever x increases 
and passes through one of the values a, b or c, leading to the following signs alternation: 

..}).. .. Q. . ../j. Then, any lower facet of should have 6 = a + 1 

and c = /c — 1; while any upper facet should have a = and c = 6+ l. Ifa;>A:; wc have 
the polynomial 

det(^) = (6 - a)(c - a)(c - 6) {d - a){d - b){d - c) ~ {x - a){x ~ b){x - c) 

which is positive whenever d > x > k, and is negative for d < x, whichever a, 6, c may 
be. Then, any lower facet relative to case 3) should have d ~ n, and any upper facet 
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should have d — k. So, the facets relative to case 3) are: 



{(^*'^*+l'^fc-l'^«)}t=0,...,fc-3' {(^0'^'■'^'+l'^fc)}^=l,...,fc-2■ 

The facets relative to cases 1) and 2) can be determined similarly. 
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